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Abstract — 3D Building change detection has become a popular 
research topic along with the improvement of image quality 
and computer science. When only building changes are of 
interest, both the multi-temporal images and Digital Surface 
Models provide valuable but not comprehensive information in 
the change detection procedure. Therefore, in this paper, belief 
functions have been adopted for fusing information from these 
two sources. In the first step, two change indicators are proposed 
by focusing on building changes. Both indicators have been 
projected to a sigmoid curve, in which both the concordance 
and discordance indexes are considered. In order to fuse the 
concordance and discordance indexes and further fuse the two 
change indicators, two belief functions are considered. One is 
the original Dempster-Shafer Theory (DST), and the most recent 
one is Dezert-Smarandache Theory (DSmT). This paper shows 
how these belief-based frameworks can help in building change 
detection problem. Besides using different belief functions in 
obtaining the global BBAs, four decision-making criteria are 
tested to extract final building change masks. The results have 
been validated by compared to the manually extracted change 
reference mask. 

I. Introduction 

Accurate and efficient detection of changes is of great 
importance for urban monitoring, which is also an important 
research field in remote sensing. Change detection methods on 
large scale land cover monitoring have been intensively studied 
and reviewed [ 1] [2] . Along with the ascending of image 
spectral and temporal resolution, the expectation on automatic 
change detection has progressively increased, not only on 
results accuracy, but also on the efficiency and robustness of 
the methods. Moreover, change detection for a specific target 
of interest, like buildings is becoming an important research 
topic. In small scale 2D change detection, which is performed 
based on only 2D multi- temporal spectral images, problems 
arise due to misdetections caused by irrelevant changes. The 
influence of these irrelevant changes is growing as higher 
resolution images showing more details. Therefore, in this 
paper, we will further work on satellite multispectral and 
stereo images, which provides both spectral and height change 
information. 

Adopting satellite stereo imagery for 3D change detection 
is an exciting and challenging task. Benefiting from improved 
data quality and advanced computer vision technique, the 
quality of the generated Digital Surface Models (DSMs) has 
been largely improved and it is possible to detect changes 
even for small objects, like single buildings. On the other 
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side, the DSMs may still exhibit some outliers resulting in 
occlusions within the stereo/multi views. Several approaches 
have been proposed for DSM assisted change detection [3], [4], 
[5], [6]. According to our previous research results, the belief 
functions introduced in DST allow to work more efficiently 
and robustly in urban building change detection with very 
high resolution satellite images [7]. So far, only a basic 
DS fusion model has been proposed in [6] to define the 
Basic Belief Assignments (BBAs) thanks to a sigmoid curve 
considering only the concordance index. Improvement of this 
DS fusion model for BBAs construction is proposed in this 
paper to achieve better performance by considering both the 
concordance and discordance indexes. Since DSmT [8] has 
been developed in last years as an interesting alternative to 
DST to circumvent problems of Dempster- Shafer’s (DS) rule 
of combination [9], we also investigate the possibility of using 
the Proportiobnal Conflict Redistribution Rule #6 (PCR6) of 
DSmT in our application. 

II. Basics of belief functions 

Detailed presentations of DST and DSmT can be found 
in [8], [9] and [10]. Let 0 be a frame of discernment of a 
problem under consideration. 0 = {<9i, # 2 , . . . , On} consists 
of a list of N exhaustive and mutually exclusive elements 6^, 
z = 1,2,..., TV. Each 6i represents a possible state related to 
the problem we want to solve. The assumption of exhaustivity 
and mutual exclusivity of elements of 0 is classically referred 
as Shafer’s model of the frame 0. A BBA also called a belief 
mass function (or just a mass for short), is a mapping ra(.) : 
2 e -A [0,1] from the power set 1 of 0 denoted 2 0 to [0,1], 
that verifies [10]: 

m(0) = 0 and ^ m(X) = 1 (1) 

m(X) represents the mass of belief exactly committed to X. 
An element X £ 2 0 is called a focal element if and only if 
m(X) > 0. In DST, the combination (fusion) of several inde- 
pendent sources of evidences is done with Dempster-Shafer 2 
(DS) rule of combination, assuming that the sources are not 
in total conflict 3 . DS combination of two independent BBAs 

^he power set is the set of all subsets of ©, empty set included. 

2 Although the rule has been proposed originally by Dempster, we call it 
Dempster-Shafer rule because it has been widely promoted by Shafer in DST. 

3 otherwise DS rule is mathematically not defined because of 0/0 indeter- 
minacy. 
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mi(.) and m 2 (.), denoted symbolically by DS(ra|*:ra 2 ), is 
defined by m DS {f)) = 0, and for all Ig 2 0 \ {0} by: 

m DS (X) = yZ~kds Y m 1 (X 1 )m 2 (X 2 ) (2) 

Xi,X 2 G2 e 

XiPlX 2 =X 

where the total degree of conflict K DS is given by 

K DS 4 Y, ™i(*iW*2) (3) 

Xi,X 2 G2 # 

XiflX 2 =0 

A discussion on the validity of DS rule and its incompatibility 
with Bayes fusion rule for combining Bayesian BBAs can be 
found in [9], [11], [12]. To circumvent the problems of DS 
rule, Smarandache and Dezert (see [8], Vol. 2, Chap. 1), then 
Martin and Osswald (see [8], Vol. 2, Chap. 2) have developed 
in DSmT [8] two fusion rules called PCR5 and PCR6 based on 
the proportional conflict redistribution (PCR) principle which 
consists 

1) to apply the conjunctive rule; 

2) calculate the total or partial conflicting masses; 

3) then redistribute the (total or partial) conflicting mass 
proportionally on non-empty sets according to the 
integrity constraints one has for the frame 0. 

This PCR principle transfers the conflicting mass only to the 
elements involved in the conflict and proportionally to their 
individual masses, so that the specificity of the information 
is not degraded. Because the proportional transfer can be 
done in two different ways, this has yielded to two different 
fusion rules. It has been proved in [13] that only PCR6 rule 
is compatible with frequentist probability estimation, and that 
is why we recommend its use in the applications. PCR5 and 
PCR6 rules simplify greatly and coincide for the combination 
of two sources. In this case, the PCR6 combination is obtained 
by taking m PCi?6 (0) = 0, and for all X fr 0 in 2 0 by 

m PCR6 (X) = ^2 rn 1 {X 1 )m 2 {X 2 )+ 

Xi,X 2 G2 # 

x 1 nx 2 =x 

v m 1 (X) 2 m 2 (y) mfrXfmfrY) 

4- [ m 1 (X)+m 2 (Y) m 2 (X)+mi(y) J 

YE2*\{X} 
xn Y=Q 

where all denominators in Eq. (4) are different from zero. If 
a denominator is zero, that fraction is discarded. 

III. Building change detection models 

A. Choice of the frame of discernment 

We now use two sources (indicators) of evidences to solve 
our problem. As a preparation step, the indicators and focal 
elements have to be introduced. Two data sources are used for 
building change detection. One is the satellite images, which 
contain 2D spectral information. Here we use the Iteratively 
Reweighted Multivariate Alteration Detection (IRMAD) [14] 
to highlight changes from the spectral images. The other is 
the robust height difference which can be calculated from 
the two Digital Surface Models (DSMs) [6]. Detail of the 
DSM generation procedure and the characters of the DSMs 
quality have been described in [5]. As it has been explained 



in [6], we suppose that new, demolished or changed buildings 
exhibit both height changes and spectral changes. The seasonal 
changes will only influence the spectral images. Therefore, 
for building change detection, we consider the following three 
classes (hypotheses) to define our frame of discernment satisfy- 
ing Shafer’s model: 0 = {#i = Pixel G BuildingChange,(9 2 = 
Pixel G OtherChange,^ = Pixel G NoChange}. 

B. Sigmoidal model for BBA construction 

BBAs construction is a prerequisite for the combination of 
sources of evidence. In our previous works [6], the BBAs were 
built based on sigmoid curves related with the concordance 
index only. In this paper, we improve our model to construct 
the BBAs thanks to sigmoidal models for both concordance 
and discordance indexes following idea proposed in [15]. As 
explained in [6], the original sigmoid curve is defined as 

f(r,T){x) =0.99/(l + e _2L ? 2: ) (5) 

where x is the original value of each indicator. Two parameters 
T and r are used to control the symmetry point and the 
slope of the sigmoid function. The symmetry point indicates 
a certainty of 50%. The construction of BBAs is explained in 
[15] and adopted in this paper. In [15] these two parameters 
T and r are manually given to sigmoid curve. Here, the 
multi-level Otsu’s thresholding method [16] is used to get 
symmetry points for both concordance index and discordance 
index. Otsu’s algorithm defines that an image is composed of 
objects and background. A discriminant analysis is performed 
by minimizing the intra-class variance. When three classes are 
of interest, two threshold values are expected. Otsu’s method 
can be extended to 

<j2(Ti,T2) =w iCT ?(Ti,T 2 ) 

+ lo 2 (t%(Ti,T 2 ) + oj3<j^(Ti,T 2 ) (6) 

The weights uji are the probabilities obtained from the image 
histogram that are separated by the thresholds and T 2 . cr^ 
are the variances of the three classes. Ti and T 2 can be used 
as the symmetry points of discordance and concordance index 
respectively. Thus, using height change index as example, the 
BBAs for discordance and concordance height change index 
are presented as a ah and b/\H 

&ah = /r,Ti (AiJ), and b^H = /-r,T 2 (A77) (7) 

The factor r is calculated with a sample value (A H = 1, 
a a h = 0.1), which means 1 meter height change indicates 
10% probability to be building changes. The BBAs for discor- 
dance and concordance image change index are built similarly. 
Differences appearing in 2D images give a concordance indi- 
cation for all changes, which include the building changes and 
other changes (%fj# 2 ). In this paper the changes from images 
are named A I mg. 

C. BBAs construction using concordance and discordance 

The BBAs related with the concordance and discordance 
indexes are combined to get the global BBA related to each 
source of evidence. These global BBAs will then be used as 
input for solving the change detection problem thanks to their 
combination. In the Tables I and II, we present the two ways 
of construction of the BBAs of the sources of evidence based 
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BBA CONSTRUCTION FOR HEIGHT CHANGE INDICATOR AH. 
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TABLE II. BBA CONSTRUCTION FOR IMAGE CHANGE INDICATOR A Img. [KAImg = ^Almg^AImg^ 
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either on DS or on PCR 6 rules of combination for the height 
change indicator (i.e. the first source of evidence) and the 
image change indicator (i.e. the second source of evidence). 
In Table I, m i(.) and m[(.) represent the concordance and 
discordance BBAs from AH, whereas in Table II m 2 (.) and 
m 2 (.) represent the concordance and discordance BBAs from 
images. 

Here for comparison of the two belief functions, these two 
BBAs are fused with both DS and PCR 6 fusion rules. The 
fusion rules for height change indicator and image change 
indicator are explained in Table I and Table II. In Table I, 
the m\ and m[ represent the concordance and discordance 
BBAs from AH. In Table II we use m 2 and m' 2 to represent 
the concordance and discordance BBAs from images. 

D. BBAs combination for building change detection 

From the previous step of BBAs modelings, each pixel 
will get two sets of BBAs to combine resulting from Table 
I and II. More precisely, we will have to combine either 
(mf ) ’ s (.), if DS rule is preferred for the BBA model- 

ing, or (mf^ R 6 (.), m 2 CR6 (.)} if PCR 6 rule is adopted. These 
BBAs have been represented by a \ , 61 , c| and a 2 ,b 2 ,C 2 in 
Table III. Based on different BBAs and fusion methods, four 
sets of global BBAs can be computed from Table III. 

G% = DS{m? 5 (.),mf 5 (.)} 

G 2 = PC/?6{mf s (.),mf s (.)} 

G 3 = DS{mH R6 (-),mH m (.)} 

G 4 = PCR6{mH m (-),m£ Cm (-)} 

After the fusion step, each pixel in the images will get a 
certain degree of belief for all focal elements. Based on the 
these BBAs, a final decision can be made. DST and DSmT 
have different approaches to get this final decision. In this 
paper four decision criteria are tested. More precisely, we have 
evaluated the maximum of global BBAs (Max_Bel), maximum 
of plausibility (Max_Pl), maximum of betting probabilities 
(Max_BetP) and the maximum of DSmP (Max_DSmP),), see 
[ 8 ] (Vol. 3, Chap. 3) and [10] for the mathematical definitions 
of Bel(.), Pl ( .), BetP(.) and DSmP{.) functions. 



TABLE III. Fusion models for building change detection. 
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IV. Experiments 

The two proposed BBAs modelings and fusion methods 
(based on DS and PCR 6 rules) have been tested on one real 
dataset. The dataset and the results from each step are detailed 
in this section. 

A. Datasets 

The experimental dataset for this research work are dis- 
played in Fig.l. It consists of two pairs of IKONOS stereo 
imagery captured at February 2006 and May 2011 respectively. 
As a pre-processing step, all data have been correctly radio- 
metrically and geographically co-registered as described in [ 6 ] . 
As shown in Fig. 1, this is a normal building change example. 
Several buildings have been built on flat surface. The generated 
DSMs are displayed in Fig. lc and d. 

B. Results and evaluation 

As the first step, BBAs from image change and height 
change are extracted and refined based on DS fusion and 
PCR 6 fusion rules. The four sets of global BBAs are prepared 
corresponding to Eq. ( 8 ). Among them the BBA for the 
focal element 6\ (Building change) are shown in Fig. 2. The 
accuracy of these BBAs have been evaluated by area under 
Receiver Operating Characteristic curve (AUC). The AUC has 
been recorded on this figure as the caption of each subfigure. 
An advantage of PCR 6 can be proved here. It has to be 
noted that the AUCs obtained here are much higher than 
using only height (AUC = 0.9299) [ 6 ] or spectral information 
(AUC=0.8823), and generally better than the fusion result 
described in [ 6 ] (AUC=0.9621). 




V. Conclusions 
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Fig. 1. Experimental dataset: a) panchromatic image from datel; b) 
panchromatic image from date2; c) DSM from datel; (d) DSM from date2. 




(a) AUC= 0.9757 





(b) AUC=0.9760 



(d) AUC=0.9767 




(c) AUC=0.9763 



Fig. 2. Four global BBAs sets (a) G i; (b)G 2 ; {c)Gs\ (d)G 4 . 



Besides the AUC comparison, the building change masks 
extracted from these four global BBAs sets are compared and 
evaluated. Each global BBA set can generate four building 
change mask based on these four decision make criteria. 
These building change masks are evaluated based on Kappa 
statistic (KA) and true detected rate (TR). In this paper 
TR = de ;r^r * 1 ^ 0 %. The comparison results of TR 
and KA values are shown in Table IV. From Table IV, one 
sees that, G% and G 4 are more advantageous than G\ and G2 . 
However, the highest KA is obtained by G\ by taking the 
Max_Pl. However, in this paper, only the reference data for 
building changes are available. For better understanding these 
four global BBAs and decision making criteria, reference data 
of all three focal elements 62 and #3 are required. 



TABLE IV. Change masks evaluation from four global BBAs. 
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Max_Bel 


93.35 


0.7729 


93.35 


0.7729 


93.39 


0.7725 


93.39 


0.7724 


Max_Pl 


93.23 


0.7768 


93.23 


0.7762 


93.23 


0.7763 


93.25 


0.7756 


Max_BetP 


93.28 


0.7747 


93.32 


0.7762 


93.32 


0.7745 


93.32 


0.7741 


Max_DSmP 


93.30 


0.7739 


93.30 


0.7734 


93.30 


0.7737 


93.34 


0.7734 



Belief functions are good choices for DSM assisted change 
detection. Firstly, once the BBA construction is well done, it 
can be robustly used for other images in other regions effi- 
ciently. Secondly, this fusion approach matches well with the 
characteristics of our research topic. Since height information 
is important for separating high/low level objects. Satellite 
images directly highlight all changes on the land surface. None 
of these two sources of information can easily and directly 
lead to a reliable decision on building changes, which matches 
with the initial idea of belief functions. Generally speaking, 
both DST and DSmT frameworks offer the possibility to 
reach a high accuracy result, and PCR6 looks advantageous 
when a larger conflict exists between the different sources 
of evidence. More experiments are under progress to provide 
a finer quantitative comparative analysis in a forthcoming 
publication. 
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